Yoda: An Accurate and Scalable Web-Based Recommendation System

Recommendation systems are applied to personalize and customize the Web environment. We have developed a recommendation system, termed Yoda, that is designed to support large-scale Web-based applications requiring highly accurate recommendations in real-time. With Yoda, we introduce a hybrid approach that combines collaborative ltering (CF) and content-based querying to achieve higher accuracy. Yoda is structured as a tunable model that is trained o -line and employed for real-time recommendation on-line. The on-line process bene ts from an optimized aggregation function with low complexity that allows realtime weighted aggregation of the soft classi cation of active users to prede ned recommendation sets. Leveraging on localized distribution of the recommendable items, the same aggregation function is further optimized for the o -line process to reduce the time complexity of constructing the pre-de ned recommendation sets of the model. To make the o -line process scalable furthermore, we also propose a ltering mechanism, FLSH, that extends the Locality Sensitive Hashing technique by incorporating a novel distance measure that satis es speci c requirements of our application. Our end-to-end experiments show while Yoda's complexity is low and remains constant as the number of users and/or items grow, its accuracy surpasses that of the basic nearest-neighbor method by a wide margin (in most cases more than 100%).